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Abstract. Stochastic games are a natural model for the synthesis of controllers con- 
fronted to adversarial and/or random actions. In particular, cij-regular games of infinite 
length can represent reactive systems which are not expected to reach a correct state, but 
rather to handle a continuous stream of events. One critical resource in such applications 
is the memory used by the controller. In this paper, we study the amount of memory that 
can be saved through the use of randomisation in strategies, and present matching upper 
and lower bounds for stochastic MuUer games. 



1. Introduction 

A stochastic game arena is a directed graph with three kinds of states: Eve's, Adam's 
and random states. A token circulates on this arena: when it is in one of Eve's states, 
she chooses its next location among the successors of the current state; when it is in one 
of Adam's states, he chooses its next location; and when it is in a random state, the next 
location is chosen according to a fixed probability distribution. The result of playing the 
game for oj moves is an infinite path of the graph. A play is winning either for Eve or 
for Adam, and the "winner problem" consists in determining whether one of the players 
has a winning strategy, from a given initial state. Closely related problems concern the 
computation of winning strategies, as well as determining the nature of these strategies: pure 
or randomised, with finite or infinite memory. There has been a long history of using arenas 
without random states (2-player arenas) for modelling and synthesising reactive processes 
[BL691 [PR89| : Eve represents the controller, and Adam the environment. Stochastic (2|- 
player) arenas [deA97j . with the addition of random states, can also model uncontrollable 
actions that happen according to a random law, rather than by choice of an actively hostile 
environment. The desired behaviour of the system is traditionally represented as an uj- 
regular winning condition, which naturally expresses the temporal specifications and fairness 
assumptions of transition systems |MP92| . From this point of view, the complexity of the 
winning strategies is a central question, since they represent possible implementations of the 
controllers in the synthesis problem. In this paper, we focus on an important normal form 
of w-regular conditions, namely Muller winning conditions (see |Tho95| for a survey). 
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In the case of 2-player Muller games, a fundamental determinacy result of Biichi and 
Landweber states that, from any initial state, one of the players has a winning strategy 
[BL69| . Gurevich and Harrington used the latest appearance record (LAR) structure of Mc- 
Naughton to extend this result to strategies with memory factorial in the size of the game 
[GH82| . Zielonka refines the LAR construction into a tree, and derives from it an elegant 
algorithm to compute the winning regions |Zie98j . An insightful analysis of the Zielonka tree 
by Dziembowski, Jurdzinski, and Walukiewicz leads to optimal (and asymmetrical) mem- 
ory bounds for pure (non-randomised) winning strategies [DJW97| . Chatterjee extended 
these bounds to the case of pure strategies over 2^-player arenas [Cha07bj . However, the 
lower bound on memory does not hold for randomised strategies, even in non-stochastic are- 
nas: Chatterjee, de Alfaro, and Henzinger show that memoryless randomised strategies are 
enough for to deal with upward-closed winning conditions [CdAH04] . Chatterjee extends 
this result in [Cha07a| . showing that conditions with non-trivial upward-closed subsets admit 
randomised strategies with less memory than pure ones. 

Our contributions. The memory bounds of |ChaQ7a| are not tight in general, even for 
2-player arenas. We give here matching upper and lower bounds for any Muller condition 
in the form of a number computed from the Zielonka tree of 

• if Eve has a winning strategy in a 2i-player game (AjT), she has a randomised 
winning strategy with memory r^ (Theorem I4.2p : 

• there is a 2-player game {A:f, J-) where any randomised winning strategy for Eve 
has at least rjr memory states (Theorem I5.2|) . 

Furthermore, the witness arenas we build in the proof of Theorem 15.21 are significantly 
smaller than in [DJW97| . even though the problem of polynomial arenas remains open. 
Outline of the paper. Section [2] recalls the classical notions in the area, while Section [3] 
presents former results on memory bounds and randomised strategies. The next two sections 
present our main results. In Section [U we introduce the number rjr and show that it is an 
upper bound on the memory needed to win in any 2^-game {A,J-). In Section [U we show 
that this bound is tight. Finally, in Section [6l we characterise the class of Muller conditions 
that admit memoryless randomised strategies, and show that for each Muller condition, at 
least one of the players cannot improve its memory through randomisation. 

2. Definitions 

We consider turn-based stochastic two-player Muller games. We recall here several 
classical notions in the field, and refer the reader to |Tho95l ldeA97j for more details. 
Probability Distribution. A probability distribution 7 over a set X is a function from X 
to [0,1] such that 'Ylix<^x^i^) ~ ^- "^^^ probability distributions over X is denoted 

by V{X). 

Arenas. A 2^-player arena A over a set of colours C consists of a directed finite graph 
(5, T), a partition {Se,Sa,Si{) of 5, a probabilistic transition function S : Sr^ T^iS) such 
that 6{s){t) > ^ {s,t) £ T, and a partial colouring function x'-'S^C. The states in Se 
(resp. Sa, Sr) are Eve's states (resp. Adam's states, random states), and are graphically 
represented as O's (resp. □, A). A 2-player arena is an arena where Sn = 0. 

A set ?7 C 5 of states is 5-closed if for every random state u € UHSr, {u,t) G T ^ t £ U . 
It is live if for every non-random state u £ U (1 {Se U Sa), there is a state t £ U such that 
(u, t) £ T. A live and (5-closed subset U induces a subarena of A, denoted by A \ U. 
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Plays and Strategies. An infinite path, or play, over the arena A is an infinite sequence 
p = popi ... of states such that {pi,pi+i) G T for all i G N. The set of states occurring 
infinitely often in a play p is denoted by Inf(p) = {s \ 3°°i GN,pi = s}. We write O for the 
set of all plays, and for the set of plays that start from the state s. 

A strategy with memory M for Eve on the arena ^ is a (possibly infinite) transducer 
a = (M, o"",o"^), where is the "next-move" function from {Se x M) to 1^(5) and is 
the "memory-update" function, from (5 x M) to T>{M). Notice that both the move and 
the update are randomised: strategies whose memory is deterministic are a different, less 
compact, model. The strategies for Adam are defined likewise. A strategy a is pure if it 
does not use randomisation. It is finite-memory if M is a finite set, and memoryless if M 
is a singleton. Notice that strategies defined in the usual way as functions from S* to S 
can be defined as strategies with infinite memory: the set of memory states is S* and the 
memory update is a^{s,w) i— > ws. 

Once a starting state s € 5 and strategies a G S for both players are fixed, the outcome 
of the game is a random walk ps'^ for which the probabilities of events are uniquely fixed 
(an event is a measurable set of paths). For an event P G 0, we denote by Ps'^(P) the 
probability that a play belongs to P if it starts from s and Eve and Adam follow the strategies 
a and r. 

A play is consistent with a if for each position i such that Wi G Se, IP^'q (/Oj+i = tt'j+i | 
po = wq . . . Pi = Wi) > 0. The set of plays consistent with a is denoted by Q'^ . Similar 
notions can be defined for Adam's strategies. 

Traps and Attractors. The attractor of Eve to the set U, denoted Attr£;(C/), is the set of 
states where Eve can guarantee that the token reaches the set U with a positive probability. 
It is defined inductively by: 

Attr^(C/) = U 

Atti'+^{U) = Attr*^(C/) U{s G 5s U Sr, 3t G Attr*^(?7) | (s, t) G T} 

U{s G Sa I Vt, {s,t) e E e Attri;(f/)} 
Attrs(f/) = U^>o Attr^^([/) 
The corresponding attractor strategy to U for Eve is a pure and memoryless strategy 
au such that for any state s e Se n {AttvE{U) \ f/), s G Attr*^^(C/) ^ au{s) G AttT^^{U). 

The dual notion of trap for Eve denotes a set from where Eve cannot escape, unless 
Adam allows her to do so: a set C/ is a trap for Eve if and only if Vs G U (^{Se'JSr), {s,t) G 
T ^ t £ U and Vs G C/ H SA,3t G U, {s,t) G T. Notice that a trap is a "strong" notion 
— the token can never leave it if Adam does not allow it to do so — while an attractor is a 
"weak" one — the token can avoid the target even if Eve uses the attractor strategy. Notice 
also that a trap (for either player) is always a subarena. 

Winning Conditions. A winning condition is a subset $ of 0. A play p is winning for 
Eve if p G <I>, and winning for Adam otherwise. We consider w-regular winning conditions 
formalised as Muller conditions. A Muller condition is determined by a subset F of the 
power set V{C) of colours, and Eve wins a play if and only if the set of colours visited 
infinitely often belongs to T: = {p G r2|x(Inf(p)) G J^}. An example of Muller game is 



given in Figure 1(a) We use it throughout the paper to describe various notions and results. 
Winning Strategies. A strategy a for Eve is surely winning (or sure) from a state s for the 
winning condition ^ if any play consistent with a belongs to and almost- surely winning 
(or almost-sure) if for any strategy r for Adam, Ps'^($) = 1- The sure and almost-sure 
regions are the sets of states from which she has a sure (resp. almost-sure) strategy. 
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f = {{a, b}, {a, b, c}, {a, b, c, d}} 
(a) The game «l = (9, f) 




(b) Zielonka Tree of f 



Figure 1: Recurring Example 
3. Former results in memory bounds and randomisation 

3.1. Pure strategies 

There has been intense research since the sixties on the non-stochastic setting, i. e. pure 
strategies and 2-player arenas. Biichi and Landweber showed the determinacy of Muller 
games in [BL69| . Gurevich and Harrington used the LAR (Latest Appearance Record) of 
McNaughton to prove their Forgetful Determinacy theorem |GH82| . which shows that a 
memory of size \C\l is sufficient for any game that uses only colours from C, even when the 
arena is infinite. This result was later refined by Zielonka in |Zie98| . using a representation 
of the Muller conditions as trees: 

Definition 3.1 (Zielonka Tree of a Muller condition). The Zielonka Tree Zj^q of a winning 
condition T C T'{C) is defined inductively as follows: 

(1) If C ^ ^, then Z:f^c = %,C' ^here T = V{C) \ T. 

(2) If C € .7^, then the root of Zj^^c is labelled with C. Let Ci, • • • , be all the 
maximal sets in {U ^ | C/ C C}. Then we attach to the root, as its subtrees, the 
Zielonka trees of .7^ f Cj, i.e. the Zjr^afii-, for i = 1 ... A;. 

Hence, the Zielonka tree is a tree with nodes labelled by sets of colours. A node of Zj^^c is 
an Eve node if it is labelled with a set from otherwise it is an Adam node. 

A later analysis of this construction by Dziembowski, Jurdzinski and Walukiewicz in 
[DJW97| led to an optimal and asymmetrical bound on the memory needed by the players 
to define sure strategies: 

Definition 3.2 (Number m^r of a Muller condition). Let T Q 'P(C) be a Muller condition, 
and Zjr_^^Ci, Zjr^^c2T ■ ■ J ^J^kfik be the subtrees attached to the root of the tree Zj^q. We 
define the number mjr inductively as follows: 



1 

k 



E 



if ZjT Q does not have any subtrees, 
yTUj^f,} \i C ^ T (Adam node), 

if C e (Eve node). 



Theorem 3.3 ( [DJW97"] ). If Eve has a sure strategy in a 2-player Muller game with the 
winning condition T , she has a pure sure strategy with at most mj^ memory states. Further- 
more, there is a 2-player arena such that Eve has a sure strategy, but none of her sure 
strategies have less than mj^ memory states. ■ 
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Theorem 3.4 ( [ChaOTbj ). If Eve has an almost-sure strategy in a 2^-player Muller game 
with the winning condition T , she has a pure almost-sure with at most rrijr memory states. ■ 



3.2. Memory reduction through randomisation 

Randomised strategies are more general than pure strategies, and in some cases, they are 
also more compact. In [CdAH04j . a first result showed that upward-closed conditions admit 
memoryless randomised strategies, while they don't admit memoryless pure strategies: 

Theorem 3.5 ( |CdAH04j ). If Eve has an almost-sure strategy in a 2^-player Muller game 
with an upward-closed winning condition, she has a randomised almost-sure strategy. m 

This result was later extended in |Cha07a| . by removing the leaves attached to a node 
of the Zielonka Tree representing an upward-closed subcondition: 

Definition 3.6 ( [ChaQ7aj ). Let JT C V{C) be a Muller condition, and Zjr^^Ci, 2yr^^e2J ■ ■ ■ ^ 
Z'Ti.fik be the subtrees attached to the root of the tree Zjr^. We define the number 
inductively as follows: 

1 if ZjTfi does not have any subtrees, 

1 if ^ is upward-closed, 

max{m^^ , > ■ ■ ■ > "^Tu i '^^ C ^ !F (Adam node) , 



-.u 



k 



^ m^. if C G (Eve node) . 



Theorem 3.7 ( |Cha07aj ). If Eve has an almost-sure strategy in a 2^-player Muller game 

4 



with the winning condition T , she has a randomised almost-sure strategy with at most 



memory states. 



4. Randomised Upper Bound 

The upper bound of Theorem [321 is not tight for all conditions. For example, the number 



of the condition jF in Figure 1(b) is three, while there is always an almost-sure strategy 
with two memory states. We present here yet another number for any Muller condition T, 
denoted r^, that we compute from the Zielonka Tree: 

Definition 4.1 (Number of a Muller condition). Let J- C V{C) be a Muller condition, 
where the root has k -|- / children, / of them being leaves. We denote by Zjr^^Cn ^Ti,Ci-, • • • > 
^T^fiu the non-leaves subtrees attached to the root of Zjr(^. We define rjr inductively as 
follows: 

1 if ZjT Q does not have any subtrees, 

, rjFj,} \iC ^ !F (Adam node). 



max{l,r^,,r^2 

k 



1=1 
k 



if C G J" (Eve node) and / = 0, 



if C G J" (Eve node) and / > 0. 
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The first remark is that if G rj^ is equal to rajr: as the leaves belong to Eve, the 
fourth case cannot occur. In the other case, the intuition is that we merge leaves if they are 
siblings. For example, the number for our recurring example is two: one for the leaves 
labelled hcd and acd, and one for the leaves labelled a and 5. The number mjr is four (one 
for each leaf), and vnP^ is three (one for the leaves labelled a and 6, and one for each other 
leaf). This section will be devoted to the proof of Theorem 14. 2t 

Theorem 4.2 (Randomised upper bound). // Eve has an almost-sure strategy in a 2-\ 
player Muller game with the winning condition T), she has an almost-sure strategy with 
memory rjr. 

Let Q = (J^, A) be a game defined on the set of colours C such that Eve wins from any 
initial node. We describe in the next three subsections a recursive procedure to compute an 
almost-sure strategy for Eve with vjr memory states in each non-trivial case in the definition 
of Tjr. We use two lemmas — Lemmas 14.31 and [45] — that derive directly from similar results 
in |DJW97j and |Cha07bj . The application of these principles to the game ?l in Figured] 
builds a randomised strategy with two memory states left and right. In left., Eve sends the 
token to (\ or and in right, to (/" or \). The memory switches from right to left with 
probability one when the token visits a c, and from left to right with probability ^ at each 
step. 

4.1. C is winning for Adam 

In the case where Adam wins the set C, the construction of a relies on Lemma B?3l 

Lemma 4.3. Let T C V{C) he a Muller winning condition such that C ^ T , and A he a 
2\-player arena such that Eve wins everywhere. There are suharenas Ai . . .An such that: 

• j => Ai^Aj = 0; 

• Vi,^j is a trap for Adam in the suharena A \ Attr^; (^^^^Aj^ ; 

• Vi,x(-4i) is included in the lahel Ei of a child of the root of Zjr^, and Eve wins 
everywhere in {Ai,T \ Ei); 

• A = ktiTE{yJj=iAj). 

Let the subarenas Ai be the ones whose existence is proved in this lemma. We denote 
by CTj the almost-sure strategy for Eve in Ai, and by ai the attractor strategy for Eve to Ai 
in the arena A \ Attr(U*~\>lj). We identify the memory states of the (Tj, so their union has 

the same cardinal as the largest of them. For a state s, if i = min{j | s G Attr(u|,^j^>tfe)}, 

E 

we define a{s, m) by: 

• if s ^ Ai 

— a^{s,m) = af{s,m) 

— a^{s,m) = af{s,m) 

• if s € AttrE{ui^iAk)\Ai 

— (T^{s, m) = m 

— (t"(s, m) = ai{s) 

By induction hypothesis over the number of colours, we can assume that the strategies 
(Tj have rjF- memory states. The strategy a uses maxjrF.} memory states. 

Proposition 4.4. P^'^(3i, Inf (p) C Ai) = 1. 
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Proof. The subarenas Ai are embedded traps, defined in such a way that the token can 
escape an Ai only by going to the attractor of a smaller one. Eve has thus a positive 
probability of reaching an Aj with j < i. Thus, if the token escapes one of the Ai infinitely 
often, the token has probability one to go to an Aj with j < i. By argument of minimality, 
after a finite prefix, the token will stay in one of the traps forever. ■ 

The strategy ai is almost-sure from any state in Ai. As Muller conditions are prefix- 
independent, it follows from Proposition 14.41 that a is also almost-sure from any state in 
A. 

4.2. C is winning for Eve, and the root of 2:r,c has no leaves among its children. 

In this case, the construction relies on the following lemma: 

Lemma 4.5. Let T C ViC) he a Muller winning condition such that C ^ T , A a 2^-player 
arena coloured by C such that Eve wins everywhere, and Ai the label of a child of the root in 
ZjTQ. Then, Eve wins everywhere on the subarena A\ Attic E{x~^iC\Ai)) with the condition 
T \Ai. 

Eve has a strategy Oi that is almost-sure from each state in ^ \ Attr£;(x~"'^(C \ Aj)). 
In this case, the set of memory states of cr is M = \Jl^-y{i x M*). The "next-move" and 
"memory-update" functions and for a memory state m = {i,m^) are defined below: 

. if S G X-^C \ A^) 

- o""(s, (i,m')) = (i -|- l,m*"^^) where m*"*"^ is any state in M*"*"-^ 

- if s G Se, o-^is, {i, m*)) is any successor of s in ^ 
. iiseAttrEix-HC\Ai)) 

- cj"(s, (i, m*)) = {i,m^) 

- cr"(s, (i,m*)) = ai{s) 

• ifs(£A\AttTE{x"'^{C\Ai)) 

- (t''(s, (i,m*)) = (z,cT^(s,m*)) 

- (T°(s, {i, m*)) = af{s, m*) 

Once again, we can assume that the memory Mj of the strategy cjj is of size rj^i-j^^. Here, 
however, the memory set of a is the disjoint union of the Mj', so cr's needs the sum of the 

Proposition 4.6. Let uc be the event "the top-level memory of a is ultimately constant". 
Then, Fsl^ip € 1 uc) = 1. 

Proof. We call i the value of the top-level memory at the limit. After a finite prefix, the token 
stops visiting x~^{C \Ai). Thus, with probability one, it also stops visiting Attr£;(x~^(C \ 
Ai)). From this point on, the token stays in the arena Ai, where Eve plays with the almost- 
sure strategy ai. Thus, F'^''^{p G ^j^\Ai \ uc) = 1, and, as ^j^\Ai ^ ^j^, Proposition 14.61 
follows. ■ 

Proposition 4.7. // the top-level memory takes each value in 1 . . .k infinitely often, then 
surely, V« G 1 . . . /c, x(Inf(/9)) ^ Ai. 

Proof. The update on the top-level memory follows a cycle on 1 . . .k, leaving i only when 
the token visits x~^(C \Ai). Thus, in order for the top-level memory to change continuously, 
the token has to visit each of the x~^{C \Ai) infinitely often. Proposition 14.71 follows. ■ 
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4.3. C is winning for Eve, and the root of Zjr c has at least one leaf in its children. 

As in the previous section, the construction relies on Lemma I4.5[ In fact, the con- 
struction for children which are not leaves, labelled Ai, . . . ,Ak, is exactly the same. The 
difference is that we add here a single memory state — — that represents all the leaves (la- 
belled A-i, . . . , A-i). The memory states are thus updated modulo k + 1, and not modulo k. 
The "next-move" function of a when the top-level memory is is an even distribution over 
all the successors in A of the current state. The "memory-update" function has probability 
^ to stay into 0, and | to go to (1,?tt.i), for some memory state mi G Mi. Thus, a uses 
memory X^^Li ^.T^i + 1- We prove now that a is almost-sure. The structure of the proof is 
the same as in the former section, with some extra considerations for the memory state 0. 

Proposition 4.8. Let uc be the event "the top-level memory of a is ultimately constant and 
different from 0". Then, Ps'^(p e <l>jr \ nc) = 1. 

Proof. The proof is exactly the same as the one of Proposition 14.61 ■ 

Proposition 4.9. The event "the top-level memory is ultimately constant and equal to 0" 
has probability 0. 

Proof. When the top-level memory is 0, the memory-update function has probability ^ at 
each step to switch to 1. Proposition 14.91 follows. ■ 

Proposition 14.101 considers the case where the top-level memory evolves continuously. 
By definition of the memory update, this can happen only if all the memory states are 
visited infinitely often. 

Proposition 4.10. Let ec be the event "the top-level memory takes each value in 0...k 
infinitely often". Then, Mi ^ -I . . . /c, Ps'^(x(Inf(p)) ^ d \ ec) = 0. 

Proof. As in the proof of Proposition 14.71 from the fact that the memory is equal to each of 
the i G 1 . . . /c infinitely often, we can deduce that the token surely visits each of the C\Ai 
infinitely often. We only need to show that, with probability one and for any j G 1 . . . / , 
the set of limit states is not included in A^j. The Zielonka Trees of the conditions !F \ A^j 
are leaves. This means that they are trivial conditions, where all the plays are winning for 
Adam. Consequently, in this case. Lemma 1431 guarantees that Attr£;(x~^(C \ A^j)) is the 
whole arena. The definition of a in the memory state (0) is to play legal moves at random. 
There is thus a positive probability that Eve will play according to the attractor strategy Oj 
long enough to guarantee a positive probability that the token visits x~^{C \ A^j). To be 
precise, for any s € S, this probability is greater than (2 • |5'|)~l'^l. Thus, with probability 
one, the token visits each x~^{C \ ^-j) infinitely often. Proposition 14. 101 follows. ■ 

The initial case, where the Zielonka tree is reduced to a leaf, is trivial: the winner does 
not depend on the play. Thus, Theorem 14.21 follows from Sections 14.11 14.21 and 14.31 

5. Lower Bound 

In this section, we consider lower bounds on memory, i.e. if we fix a Muller condition 
on a set of colours C, the minimal size of the memory set that is enough to define randomised 
almost-sure strategies for Eve on any arena coloured by the set C. In his thesis, Majumdar 
showed the following theorem: 
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Theorem 5.1 ( |Maj03| ). For any set of colours C, there is a 2-player Muller game Qc = 
{Ac-iJ'c) such that Eve has an almost sure, hut none of her almost-sure strategies have less 
than ^! memory states. 

However, this is a general lower bound on all Muller conditions, while we aim to find 
specific lower bounds for each condition. We prove here that there is a lower bound for each 
Muller condition that matches the upper bound of Theorem 14.21 

Theorem 5.2. Let J- he a Muller condition on C. There is a 2-player arena Ajr over C 
such that Eve has a sure strategy, hut none of her almost-sure strategies have less than rjr 
memory states. 

As the construction of the upper bound was based on the Zielonka tree, the lower bound 
is based on the Zielonka DAG: 

Definition 5.3. The Zielonka DAG I'jr^c of a winning condition J- C 'P{C) is derived from 
Z'Tfi by merging the nodes which share the same label. 

5.1. Cropped DAGs 

The relation between rj: and the shape of Vjt q is asymmetrical: it depends directly on 
the number of children of Eve's nodes, and not at all on the number of children of Adam's 
nodes. The notion of cropped DAG is the next logical step: a sub-DAG where Eve's nodes 
keep all their children, while each node of Adam keeps only one child: 

Definition 5.4. A DAG (£" is a cropped DAG of a Zielonka DAG Vjt q if and only if 

• The nodes of £ are nodes of Djr^., with the same owner and label. 

• There is only one node without predecessor in i5, which we call the root of £. It is 
the root of Vjtq^ if it belongs to Eve; otherwise, it is one of its children. 

• The children of a node of Eve in £ are exactly its children in Dj^q. 

• A node of Adam has exactly one child in f , chosen among his children in X'jr.c, 
provided there is one. If it has no children in Djtq^ it has no children in £. 

Cropped DAG resemble Zielonka DAGs: the nodes belong to either Eve or Adam, and 
they are labelled by sets of states. We can thus compute the number r^ of a cropped DAG 
in a natural way. In fact, this number has a more intuitive meaning in the case of cropped 
DAGs: if the leaves belong to Eve, it is the number of branches; if Adam owns the leaves, it 
is the number of branches with the leaf removed. Furthermore, there is a direct link between 
the cropped DAGs of a Zielonka DAG Vjr (^ and the number r^: 

Proposition 5.5. Let !F he a Muller condition on C, and Vjtq he its Zielonka DAG. Then 
there is a cropped DAG £* such that r^* = rjr. ■ 

5.2. From cropped DAGs to arenas 

From any cropped DAG £ of I'jf.c, we define an arena As which follows roughly the 
structure of £: the token starts from the root, goes towards the leaves, and then restarts 
from the root. In her nodes. Eve can choose to which child she wants to go. Adam's choices, 
on the other hand, consists in either stopping the current traversal or allowing it to proceed. 

We first present two "macros", depending on a subset of C: 
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• in Pick*(C), Adam can visit any subset of colours in C; 

• in Pick(L'), he must visit exactly one colour in D. 

Both are represented in Figure and they are the only occasions where colours are visited 
in As'- all the other states are colourless. 

C = {ci . . .Cfc} 

(a) Pick*(C) 

Figure 2: Pick*(C) and Pick(D) 

Eve's states in the arena As are in bijection with her nodes in £. Adam's nodes, on the 
other hand, are in bijection with the pairs parent-child of where the parent belongs to 
Eve and the child to Adam. 

In the state corresponding to the node n. Eve can send the token to any state of the 
form n — c. In states corresponding to leaves. Eve has no decision to take, and Adam can 
visit any colours in the label of the leaf (Pick* procedure). The token is then sent back to 
the root. 

Adam's moves do not involve the choice of a child: by Definition 15.41 Adam's nodes in 
£ have but one child. Instead, he can either stop the current traversal, or, if the current 
node is not a leaf, allow it to proceed to its only child. If he chooses to stop, Adam has to 
visit some coloured states before the token is sent back to the root. The available choices 
depend on the labels of both the current and the former nodes — which is why there are 
as many copies of Adam's nodes in As as they have parents in If the parent is labelled 
by E, and the current node by the token goes through Pick*(£^) and V\c]s.{E\A). Adam 
can thus choose any number of colours in E, as long as he chooses at least one outside of A. 

'Pick*(£;) ' 

_':::t:::, 

Pick(£; \ A) ' 

■---y---' 

root 

(a) Edge "E" - "A" when "A" is a node (b) Edge - "A" when "A" is a leaf 

Figure 3: Adam's states in As- 



5.3. Winning strategy and branch strategies 

We first describe a sure strategy <; for Eve in the game {As,J^)- Its memory states are 
the branches of £, and do not change during a traversal. If the current memory state is 
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b = EiAi . . . Ei{A(), Eve's moves follow the branch h: in she goes to Ei — Ai. When 
Adam stops the traversal at the ith step, Eve updates her memory as follows: 

• If Ei has zero or one child in £, the memory is unchanged; 

• otherwise, the new memory branch has £'1^1 . . . EjA as a prefix, where A is the next 
child of Ei, or the first one if Ai was the last. 

Proposition 5.6. The strategy <j is surely winning for Eve in the game {A£,T). 

Proof. Let p be a play consistent with We denote by i the smallest integer such that 
traversals stops infinitely often at the ith step. After a finite prefix, the first 2i — 1 nodes in 
the memory branch are constant, and we denote them by E1A1E2 ■ ■ ■ Ei. From this point 
on, the colours visited belong to Ei. Furthermore, each time a traversal stops at step i, a 
state is visited outside of the current Ai, which changes afterwards to the next, in a circular 
way. It follows that Inf(p) C Ei, and, for any child A of Ei in £, Inf(/9) ^ A. Thus p is 
winning for Eve. Proposition 15.61 follows. ■ 

Obviously, Adam has no winning strategy in Ae. However, we describe the class of 
branch strategies, whose point is to punish any attempt of Eve to win with less than rjr 
memory states. There is one such strategy rj, for each branch b in £ (whence the name), 
and the principle is that stops the traversal as soon as Eve deviates from b: 

Definition 5.7. The branch strategy for Adam in As, corresponding to the branch 
b = E1A1E2 ■ . . Eg{A(^) in £, is a positional strategy whose moves are described below. 

• In a state E — A such that 3i, E = Ei A A Ai: stop the traversal and visit Ai; 

• in a state E — A such that 3i, E = Ei A A = Ai: send the token to 

• in the state E^ — A^, or the leaf Ef. visit the colours of E^. 

No move is given for a state E — A such that ^i, E ^ Ei, as these states are not reachable 
from the root when Adam plays ti,. Notice also that when Adam chooses to stop a traversal 
in a state Ei — A, he can visit exactly the colours of A^: as A and Ai are maximal subsets 
of Ei, there is at least one state in Ai\ A that he can pick in the Pick(£'j \ A) area. 

5.4. Winning against branch strategies 

The key idea of the proof of Theorem 15.21 is that if two branches b and b' of £ are too 
different. Eve needs different memory states to win against Tb and Tb'. 

Proposition 5.8. Let a = {M,a^,a^) be an almost-sure strategy for Eve in {A£,J^). Then 
a has memory at least r^. 

Proof. Let b = EiAi . . . Ei{Ai) be a branch of £ and Tb be the corresponding branch strategy 
for Adam. By definition of Tb, the set of colours visited in a traversal consistent with Tb is 
one of the Aj's, or Ei if and only if Eve plays along b. As a is almost-sure, there must be a 
memory state m such that Eve has a positive probability to play along b. It is also necessary 
to ensure that none of the Ai^s is visited infinitely often, with the possible exception of Ag. 
So, if Eve has a positive to play along a branch b' when she is in the memory state m, 
EiAi . . . Ei must be a prefix of b' . It follows that a single memory state can be suitable 
against two strategies Tb and Tb' with b = EiAi . . . E£{A£) and b' = E[A\ . . . E'p{A'^,) only 
if £ = i' and Vi < £, Ei = E[. By Definition 14.11 the underlying equivalence relation has rs 
equivalence classes. Proposition 15.81 follows. ■ 
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By Proposition 15.51 there is a cropped DAG £ of Vj^^ such that rs = rr. So, in 
general, Eve needs randomised strategies with memory in order to win games whose 
winning condition is T. This completes the proof of Theorem 15.21 

6. Conclusion 

We have provided better and tight bounds for the memory needed to define almost sure 
winning randomised strategies. This allows us to characterise the class of Muller conditions 
which admit randomised memoryless strategies: 

Corollary 6.1. Eve admits randomised memoryless almost-sure strategies for a Muller con- 
dition T if and only if all her nodes in Zjr^c have either one child, or only leave children, m 

This yields a NP algorithm for the winner problem of such games, as solving 1 ^-player 
Muller games is Ptime [CdAH04| . Another consequence of our result is that for each Muller 
condition, at least one of the players cannot improve its memory through randomisation: 

Corollary 6.2. Let T be a Muller condition. If ^ G T, Eve needs as much memory for 
randomised strategy as for pure strategies. Otherwise, Adam does. m 

Our proof of lower bound also improves on the size of the witness arena: it is roughly 
equivalent to the size of the Zielonka DAG, instead of the size of the Zielonka tree. Whether 
these bounds still hold for arenas of size polynomial in the number of colours remains an 
open question, except for special cases like Streett games |Hor07j . 
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